DEBLOCKING FILTERING .APPARATUS AND METHOD 



Background of the Invention 

The present invention relates to the processing performed 
for a recovered image during a digital image compression process , 
and relates in particular to a deblocking filtering apparatus 
and method defined in MPEG-4. 

For the processing of digital images, the internationally 
accepted MPEG digital image compression standards provide 
for the employment of a discrete cosine transform. This is 
an irreversible transform used for quantization, and depending 
on the condition of an original image, a phenomenon occurs 
whereby a pseudo outline having a block shape (block noise) , 
which is inherent to the system, may appear in a recovered 
image . 

As a countermeasure, Vertif ication Model 7 . 0 of the MPEG-4 
video standards defines a deblocking filter as a post process 
for a recovered image. As is shown in Fig. 3, the defined 
deblocking filter performs filtering for ten received pixel 
values positioned around the block boundary, and outputs eight 
pixel values positioned around the block boundary. Two types 
of operation modes, a DC offset mode operation (hereinafter 
referred to as a D mode operation) and a default mode operation, 
are switched in accordance with a change value (hereinafter 
referred to as an activity) for the value of a pixel near 



the block boundary. An evaluation function representing the 
activity employs the following equation (1) . 
f = 4>{g(0)-g(l) } + <Mg(D-g(2) } + <Mg (2) -g (3) }+ <}>{g (3) -g (4) } 
+ (j){g(4)-g(5) } + <Mg (5) -g (6) } + <j>{g (6) -g (7) } 
5 + (j){g(7)-g(8) } + <j) { g ( 8 ) -g ( 9 ) } 

where 

if (abs (x)<=Thl) <f>(x) = 1; 

else (j)(x) =0 ... (1) 

According to an evaluation function f in equation (1), 

10 for ten pixel values positioned around a block boundary, an 
absolute differential value for the difference between adjacent 
pixel values is compared with a threshold value Thl, and a 
count is acquired of the locations whereat the absolute 
differential value is equal to or smaller than the threshold 

15 value Thl. If the value of the evaluation function f is equal 
to or greater than a threshold value Th2, i.e., when the activity 
is low, the D mode operation is selected. But if the value 
of the evaluation function f is smaller than the threshold 
value Th2, i.e., when the activity is high, the default mode 

20 operation is selected. 

A more effective smoothing process is performed for a 
D mode operation than is performed for a default mode operation, 
as is illustrated by an operation equation (2) that is shown 
below. The smoothing process is performed if the absolute 

25 differential value between a maximum pixel value and a minimum 
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pixel value for a string of eight pixels positioned around 
a block boundary is smaller than twice a quantization parameter 
QP. If the absolute differential value is equal to or greater 
than twice the quantization parameter QP, the smoothing process 
5 is not performed and an input pixel value is output unchanged. 
MAX = max { ( g ( 1 ) , g(2), g(3), g(4), g(5), g(6), g(7), g(8)}; 
MIN = min{ (g(l) , g(2), g(3), g(4), g(5), g(6), g(7), g(8)); 
if (abs (MAX-MIN) ) <2*QP) { 

min#padding=abs <g(0) -g(l) )<QP?g(0) :g(l) ; 
10 max#padding=abs (g(8)-g{9) )<QP?g(9) :g(8) ; 

g' (n)=0; 

for (i=-4;i<5;i++) 

g' (n) +=coef (i+4) * (n+l<l?min#padding:n+i>8? 
max#padding: g (n+i) ) ) ; 

15 ... (a) 

g' (n) = (g' (n)+8)»4; 

} 

else 

g' (n)=g(n) 

20 (where coef (9) ={ 1, 1, 2, 2, 4, 2, 2, 1, 1 } ) ... (2) 

Anequation (3) is obtained by specially developing formula 
(a) in equation (2), and the smoothing process is performed 
by a weighting function employed mainly for a target pixel 
and the logical sum of the input pixel string. 
25 g' (l)=min+min+2*min+2*min+4*g(l)+2*g(2)+2*g(3)+g(4)+g(5) ; 
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g' (2)=min+min+2*min+2*g(l)+4*g(2) +2*g(3)+2*g(4)+g(5')+g(6) ; 
g' (3)=min+min+2*g(l)+2*g(2)+4*g(3)+2*g(4)+2*g(5)+g(6)+g(7) 

g' (4)=min+g(l)+2*g(2)+2*g(3)+4*g(4)+2*g(5)+2*g(6)+g(7)+g(8 
) ; 

g' (5)=g(l) +g(2)+2*g(3)+2*g(4)+4*g(5)+2*g(6)+2*g{7)+g(8)+ma 
x; 

g' (6)=g(2)+g(3)+2*g(4)+2*g(5)+4*g(6)+2*g(7)+2*g(8)+max+max 

g' (7)=g(3)+g(4)+2*g(5)+2*g(6)+4*g(7)+2*g(8)+2*max+max+max; 
g' (8)=g(4)+g(5)+2*g(6)+2*g(7) +4*g ( 8 ) +2*max+2*max+max+max; 
min : min#padding, max:max#padding 
... (3) 

TAn equation (4) is employed for the default mode operation . 
The smoothing process is performed only for two pixels along 
a block boundary, and the input values for the other pixels 
are output unchanged. 
max=(g(4)-g(5) ) /2 
d=nint (5* (actO'-actO) /8) ; 

if ( (abs (actO) < QP) && (sign (max) ==sign (d) ) ) 
d=(abs(d) > abs (max)) ? max :d; 

else 

d=0; 
g* (4)=g(4)-d; 
g' (5)=g(5) -d; 



where QP is a quantization parameter of a macro block to which 
g(5) belongs, 

actO=nint( (2*g (3) -5*g (4) + 5*g (5) -2*g (6) )/8) ; 

actl=nint ( (2*g (1) -5*g (2) + 5*g (3) -2*g (4) )/8) ; 

act2=nint( ( 2*g ( 5 ) -5*g ( 6) +5*g ( 7 ) -2 *g ( 8 ) )/8) ; 

actO T =sign (actO) -min (abs (actO) , abs(actl), abs(act2)), 
where no operation is performed for g(l) to g(3) and g(6) 
to g(8) ... (4) 

Further, instead of the default mode operation, Telenor's 
adaptive filtering (hereinafter referred to as a T mode 
operation) , which has a smaller calculation amount, may be 
employed, as is illustrated by a T mode operation (5) that 
follows . As well as in the default mode operation, the smoothing 
process is performed for only two pixels along a block boundary, 
and the input values of all other pixels are output unchanged. 

For the two pixels along the block boundary, when the evaluation 
function d in equation (5) is equal to or smaller than a 
quantization parameter QP/2, a smoothing process is performed 
in which the value of the evaluation function d is added to 
or is subtracted from the input pixel value. Then, if the 
evaluation function value d is greater than the quantization 
parameter QP/2, the input pixel value is output unchanged. 

d= (g(3) -3*g(4) +3*g(5) -g{6)+4) » 3; 
g*(4)= abs(d) > (QP/2) ? g ( 4 ) : g (4 ) +d; 
g' (5)= abs(d) > (QP/2) ? g(5):g(5)-d, 



where no operation is performed for g(l) to g(3) and g(6) 
to g(8) ... (5) 

The above deblocking filtering defined by MPEG-4 is first 
performed along all horizontal edges, and is then performed 
5 along all vertical edges. 

The above deblocking filter operation is performed, using 
software, by a general-purpose calculator in a processor, 
or part of the deblocking filter operation is performed by 
special hardware and the remainder of the operation is performed, 
10 using software, by a general-purpose calculator in a processor . 

Fig. 4 is a block diagram showing the special hardware 
operation for formula (a) in the D mode operation equation 
(2) . In Fig. 4, a counter 100 counts processing cycles from 
0 to 7, operation blocks 101 to 108 correspond to filtering 
15 target pixels n (n is an integer from 1 to 8), and an output 
selector 109 selects one of the outputs of the operation blocks 
101 to 108. 

The operation block 101 includes: first and second 
selectors nil and nl2, for receiving at least two of the 

20 externally input data max_padding, min_padding, input pixel 
values g(x) and g(x+l), and data 0; a third selector nl3, 
for receiving data "8" and the output of a register nl7, which 
will be described later; first and second shifters nl4 and 
nl5, for shifting the output of both the first and the second 

25 selectors nil and nl2; an adder nl6 for adding the output 



of the first and the second shifters nl4 and nl5 to the output 
of the third selector nl3; the register nl7, for holding the 
output of the adder nl6; and a third shifter nl8, for shifting 
the output of the register nl7. 
5 The operation blocks 102 to 108 have the same configuration 

as the operation block 101, and include, respectively, first 
selectors n21, n31, n41, n51, n61, n71andn81; second selectors 
n22, n32, n42, n52, n62, n72 and n82; third selectors n23, 
n33, n43, n53, n63, n73 and n83; first shifters n24, n34, 

10 n44, n54, n64, n74 and n84; second shifters n25, n35, n45, 
n55, n65, n75 and n85; adders n26, n36, n46, n56, n66, n76 
and n86; registers n27, n37, n47, n57, n67, n77 and n87; and 
third shifters n28, n38, n48, n58, n68, n78 and n88. 

Since software is used for conventional deblocking 

15 filtering, a large number of operating cycles is required 
and the processing is slow. Further, when as in the conventional 
art special hardware is used for a part of an operation in 
order to increase the processing speed, both a processor and 
special hardware are required, and this increases manufacturing 

20 costs. 

Summary of the Invention 
It is, therefore, one objective of the present invention 
to implement a hardware configuration that requires only a 
25 small number of cycles to perform the overall deblocking 
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filtering, so that a deblocking filtering apparatus having 
a small circuit structure can be provided without a software 
process and a processor being required. 

According to a first aspect of the invention, a deblocking 
filtering apparatus comprises: 

a Dmode operation circuit for performing a Dmode operation 
for a deblocking filter defined in MPEG-4; 

a T mode operation circuit for performing a T mode 
operation; 

an operation mode determination circuit for employing 
a change in a pixel value near a block boundary to adaptively 
determine whether the D mode operation or the T mode operation 
should be performed; and 

a selector for selecting, in accordance with the output 
of the operation mode determination circuit, either the output 
of the D mode operation circuit or the output of the T mode 
operation circuit, 

wherein the D mode operation circuit, the T mode operation 
circuit and the operation mode determination circuit are 
operated in parallel in synchronization with the input timings 
of pixel values that are sequentially input. 

According to a second aspect, in the deblocking filtering 
apparatus of the first aspect, the operation mode determination 
circuit performs a process before, in a time series, the 
processes for the D mode operation circuit and the T mode 



operation circuit; selects either the D mode operation circuit 
or the Tmode operation circuit as an adaptive operation circuit; 
and transmits a fixed value, instead of an input pixel value, 
to a non-adaptive operation circuit. 
5 According to a third aspect of the invention, in the 

deblocking filtering apparatus of the first aspect, the D 
mode operation circuit includes: 

a shift register group for shifting an input pixel value; 

a first absolute differential value operation circuit 
10 for obtaining an absolute differential value for a difference 
between adjacent registers of the shift register group; 

a first comparator for comparing the output of the first 
absolute differential operation circuit with a first threshold 
value; 

15 a first selector for selecting a specific register output 

by the shift register group in accordance with the output 

of the first comparator; 

a sequence counter for counting the number of cycles 

following the initiation of the operation; 
20 first and second registers for holding the output of the 

first selector for a specific cycle indicated by the sequence 

counter; 

a selector group for changing between the specific register 
output of the shift register group and output of the first 
25 and the second register in accordance with a cycle indicated 
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by the sequence counter; 

a first shifter group for shifting the output of the 
selector group to the left; 

a first adder group for adding together the output of 
the selector group and the output of the first shifter group; 

a first shifter for shifting the output of the first adder 
group to the right; 

third and fourth registers for holding the maximum value 
and the minimum value for the specific register output of 
the shift register group during a specific cycle indicated 
by the sequence counter; 

a second absolute differential value operation circuit 
for obtaining an absolute differential value for a difference 
between the third and the fourth registers; 

a second comparator for comparing the output of the second 
absolute differential value operation circuit with a second 
threshold value; 

a second selector for changing the specific register output 
of the shift register group and the output of the first shifter 
in accordance with the output of the second comparator. And 
the T mode operation circuit includes: 

a second shifter group for shifting to the left the specific 
register output of the shift register group; 

a second adder group for adding the specific register 
output of the shift register group and the output of the second 



shifter group; 

a second shifter for shifting the output of the second 
adder group to the right; 

an adder for adding the output of the second shifter to 
5 the specific register output of the shift register group; 

a subtracter for subtracting the output of the second 
shifter from the specific register output of the shift register 
group; 

a third comparator for comparing the absolute value for 
10 the output of the second shifter with a third threshold value; 
and 

a third selector for switching the specific register output 
of the shift register group, the output of the adder and the 
output of the subtracter in accordance with the output of 
15 the third comparator . The operationmode determination circuit 
includes : 

a third absolute differential value operation circuit 
for obtaining an absolute differential value for a difference 
between adjacent registers in the shift register group; 
2 0 a fourth comparator for comparing the output of the third 

absolute differential value operation circuit with a fourth 
threshold value; 

a counter for cumulatively adding the output of the fourth 
comparator; and 

25 a fifth comparator for comparing the output of the counter 
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with a fifth threshold value. The deblocking filtering 
apparatus further comprises: a fourth selector for switching 
the output of the D mode operation circuit and the output 
of the T mode operation circuit in accordance with the output 
5 of the operation mode determination circuit. 

According to a fourth aspect of the invention, a deblocking 
filtering method comprises: 

a D mode operation step of performing a D mode operation 
for a deblocking filter defined in MPEG-4; 
10 a T mode operation step of performing a T mode operation; 

an operation mode determination step of employing a change 
in a pixel value near a block boundary to adaptively determine 
whether the D mode operation or the T mode operation should 
be performed; and 
15 a step of selecting either the output at the Dmode operation 

step or the output at the T mode operation step in accordance 
with the output at the operation mode determination step, 

wherein the D mode operation, the T mode operation and 
the operation mode determination are performed in parallel 
20 in synchronization with the input timings for pixel values 
that are sequentially input. 

According to a fifth aspect, in the deblocking filtering 
method of the fourth aspect, the operation mode determination 
is performed before, in a time series, the D mode operation 
25 and the T mode operation are initiated, either the D mode 
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operation or the T mode operation is determined as an adaptive 
operation, and a fixed value, rather than an input pixel value, 
is input as a non-adaptive operation. 

According to the first and fourth aspect, the D mode 
operation circuit, the Tmode operation circuit and the operation 
mode determination circuit, all of which process sequentially 
input pixel values, are operated in parallel and in 
synchronization with the input timing for the pixel value. 
Thus, all the operations can be completed within the number 
of process cycles for the operation circuit having the maximum 
process cycles. Therefore, the software process that uses 
the general-purpose calculator of the computer is not required, 
and the deblocking filtering can be performed quickly and 
requires only a small number of process cycles. 

According to the second and fifth aspect, the operation 
mode determination is performed before the D mode operation 
and T mode operation. Therefore, an adaptive operation can 
be determined in advance, and the input pixel value for a 
non-adaptive operation can be defined as a fixed value. Thus, 
both the number of calculations required and the power 
consumption can be reduced. 

Brief Description Of The Drawings 
Fig. 1 is a block diagram showing a deblocking filtering 
apparatus according to one embodiment of the invention. 



Fig. 2 is a timing chart- for the deblocking filtering 
apparatus according to the embodiment of the invention. 

Fig. 3 is a diagram showing the locations of pixels that 
are input to a deblocking filter defined by MPEG-4. 

Fig. 4 is a block diagram showing a conventional operation 
apparatus for performing a D mode operation. 

Detailed Description of the Preferred Embodiment 
The preferred embodiment of the invention will now be 
described while referring to the accompanying drawings. Fig. 
1 is a block diagram showing a deblocking filtering apparatus 
according to this embodiment. 

In Fig. l, the deblocking filtering apparatus comprises: 
a shift register group 1; a first absolute differential value 
calculation circuit 2, for calculating the absolute 
differential value for a difference between specific adjacent 
registers in the shift register group 1; a first comparator 
3, for comparing the output of the first absolute differential 
calculation circuit 2 with a quantization parameter QP (first 
threshold value) ; a first selector 4, for employing the output 
of the first comparator 3 to select one of the register values 
to be input to the first absolute differential calculation 
circuit 2; a sequence counter 5; and first and second register 
values 6 and 7 , for holding the output of the first selector 
4 during a specific sequence cycle indicated by the count 
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value of the sequence counter_5. 

Further, the deblocking filtering apparatus comprises: 
a selector group 8, for switching the output of the shift 
register group 1 and the output of the first and of the second 
5 registers in accordance with the output of the sequence counter 
5; a first shifter group 9, for shifting the output of the 
selector group 8 one bit or two bits to the left; a first, 
two-input adder group 10, for adding the output of the selector 
group 8 to the output of the first shifter group 9; and a 

10 first shifter 11, for shifting the output of the two-input 
adder group 10 four bits to the right. 

The deblocking filtering apparatus also comprises: a 
third register 12, for holding the maximum value for a specific 
register output by the shift register group 1; a fourth register 

15 13, for holding the minimum value for a specific register 
output by the shift register group 1; a second absolute 
differential value calculation circuit 14, for obtaining the 
absolute differential value for a difference between the third 
register output and the fourth register output; a second 

20 comparator 15, for comparing the output of the second absolute 
differential value calculation circuit 14 with a value (second 
threshold value) that is twice that of the quantization parameter 
QP; and a second selector 16, for switching the output of 
the specific register in the shift register group 1 and the 

25 output of the first shifter 11 in accordance with the results 
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of the second comparator 15. The components 1 to 16 constitute 
an operation block for the D mode operation. 

In Fig. 1, the deblocking filter ing apparatus additionally 
comprises: a second shifter group 17; a second two-input adder 
group 18, for adding the output of a specific register in 
the shift register group 1 to the output of the second shifter 
group 17; a second shifter 19, for shifting the output of 
the second two-input adder group 18 three bits to the right; 
a two-input adder 20, for adding the output of the second 
shifter 19 to the output of the specific register in the shift 
register group 1; a two-input subtracter 21, for subtracting 
the output of the second shifter 19 from the output of the 
specific register in the shift register group 1; a third 
comparator 22, for comparing the output of the second shifter 
19 with a quantization parameter QP/2 (third threshold value) ; 
and a third selector 23, for switching the output of a specific 
register in the shift register group 1, the output of the 
two-input adder 20 and the output of the two-input subtracter 
21 in accordance with the output of the third comparator 22. 

The components 17 to 23 constitute an operation block for 
the T mode operation. 

Furthermore, the deblocking filtering apparatus in Fig. 
1 comprises: a third absolute differential value calculation 
circuit 24, for calculating the absolute differential value 
for a difference between specific adjacent registers in the 



shift register group 1; a fourth comparator 25, for comparing 
the output of the third absolute differential calculation 
circuit 24 with a threshold value Thl ( fourth threshold value) ; 
a counter 2 6, for cumulatively adding the output of the fourth 
5 comparator 25; a fifth comparator 27, for comparing the output 
of the counter 26 with a threshold value Th2 (fifth threshold 
value) ; and a fourth selector 28, for switching the output 
of the second selector 16 with the output of the third selector 
23 in accordance with the output of the fifth comparator 27. 

10 Together, the components 24 to 2 8 form an operation mode 
determination circuit block for determining whether a D mode 
operation or a T mode operation should be selected. In Fig. 
1, a timing adjustment register is provided as needed in the 
circuit in order to adjust the number of operation cycles 

15 that differ in the processing paths. 

The operation of the thus arranged deblocking filtering 
apparatus in this embodiment will now be explained while 
referring to Fig. 2. The processing for a vertical block 
boundary will be explained; however, the same process is 

20 performed for a horizontal block boundary by changing the 
order in which the pixel values are input. 

Ten pixel values positioned along the block boundary, 
a(0), a(l), a(2), a(3), a(4), a(5), a(6), a(7), a(8) anda(9), 
are arranged in order, beginning with a(0) on the left; and 

25 ten pixel values positioned along the block boundary of the 
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next line, b(0), b(l), b(2), b(3), b(4), b(5), b(6), b(7), 
b(8) and b(9), are arranged in order, beginning with b(0) 
on the left. Pixel value data is transmitted to the shift 
register group 1 each cycle in the order a(0), a(l) and a (2), 
5 and when the cycle for transmitting a(0) is defined as cycle 
0, at cycle 1, a(0) serves as the output of the first register 
of the shift register group 1, and at cycle 2, a(0) serves 
as the output of the second register. 

At cycle 7, whereat the sixth register output by the shift 
10 register group 1 is a(l) and the seventh register output is 
a (0) , the first absolute differential value calculation circuit 

2 calculates the absolute differential value for the difference 
between a(0) and a(l) . At the next cycle, the first comparator 

3 compares the absolute differential value with the quantization 
15 parameter QP . Then, if as the result of a comparison it is 

found that the absolute differential value is smaller than 
the quantization parameter QP, the first selector 4 selects 
a(0) , which is the output of the eighth register in the shift 
register group 1 . However, if the absolute differential value 

20 is found to be equal to or greater than the quantizationparameter 
QP, the first selector 4 selects a(l), which is the output 
of the seventh register in the shift register group 1. The 
first register 6 holds the output of the first selector 4. 
The value held by the first register 6 is min_padding value 

25 in equation (2) . 
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Similarly, at cycle 15, whereat the sixth register output 
by the shift register group 1 is a (9) and the seventh register 
output is a (8), the first absolute differential value 
calculation circuit 2 calculates the absolute value for the 
5 difference between a (8) and a (9) . At the next cycle, the first 
comparator 3 compares the obtained absolute differential value 
with the quantization parameter QP. Then, if as the result 
of a comparison it is found that the absolute differential 
value is smaller than the quantization parameter QP, the first 

10 selector 4 selects a(9), which is the output of the seventh 
register in the shift register group 1. However, if the output 
of the absolute differential value is found to be equal to 
or greater than the quantization parameter QP, the eighth 
register output, a (8), is selected. The second register 7 

15 holds the output of the first selector 4. The value held by 
the second register 7 is the max_padding value in equation 
(2) . 

After cycle 13, a smoothing process is performed by using 
the 8-th to the 16-th register outputs of the shift register 
20 1, and the min_padding value and the max_padding value. Each 
selector in the selector group 8 is operated in the following 
manner during a period extending from cycle 13 to cycle 20. 

The selector A outputs the value of the eighth register in 
the shift register group 1 during a period extending from 
25 cycle 13 to cycle 16, and outputs the max_padding value during 
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a period extending from cycle .17 to cycle 20. The selector 
B outputs the value of the ninth register in the shift register 
group 1 during a period extending from cycle 13 to cycle 17, 
and outputs the max_padding value during a period extending 
from cycle 18 to cycle 20. The selector C outputs the value 
of the tenth register in the shift register group 1 during 
a period extending from cycle 13 to cycle 18, and outputs 
the max_padding value during a period extending from cycle 
19 to cycle 20 . The selector D outputs the value of the eleventh 
register in the shift register group 1 during a period extending 
from cycle 13 to cycle 19, and outputs the max_padding value 
at cycle 20. 

The selector E outputs the min_padding value at cycle 
13, and outputs the value of the thirteenth register during 
a period extending from cycle 14 to cycle 20. The selector 
F outputs the min_padding value during a period extending 
from cycle 13 to cycle 14, and outputs the value of the fourteenth 
register during a period extending from cycle 15 to cycle 
20. The selector G outputs the min_padding value during a 
period extending from cycle 13 to cycle 15, and outputs the 
value of the fifteenth register during a period extending 
fromcycle 16 to cycle 20 . The selector H outputs themin_padding 
value during a period extending from cycle 13 to cycle 16, 
and outputs the value of the sixteenth register during a period 
extending from cycle 17 to cycle 20. 
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Then, the first shifter group 9 shifts the output of each 
of the selectors C to F in the selector group 8 one bit to 
the left, and shifts the output of the twelfth register of 
the shift register group 1 two bits to the left. Further, 
5 the first two-input adder group 10 sums the output of the 
selectors A, B, G and H of the selector group 8 and the output 
of the shifters of the first shifter group 9, and to this 
adds a constant "8". Finally, the second shifter 11 shifts 
the results four bits to the right, and obtains the pixel 

10 value at the completion of the smoothing process. 

The following operation is performed to determine whether, 
as the output of the D mode operation, the pixel value obtained 
at the completion of the smoothing process should be output, 
or whether the input pixel value should be output unchanged. 

15 The output each cycle of the second shift register in 

the shift register group 1 is compared during a period extending 
from cycle 3 to cycle 10, and the maximum value of the input 
pixel values a(l) to a (8) is held in the third register 12 
and the minimum value of the input pixel values a(l) to a (8) 

20 is held in the fourth register 13. At cycle 12, the second 
absolute differential value calculation circuit 14 calculates 
the absolute differential value for the difference between 
the values held in the third register 12 and the fourth register 
13. Then, at cycle 13, the second comparator 15 compares the 

25 absolute differential value with twice the quantization 
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parameter QP. If, as a result of the comparison, it is determined 
that the output of the second absolute differential value 
calculation circuit 14 is smaller than twice of the quantization 
parameter QP, the second selector 16 selects the pixel value 
5 obtained at the completion of the smoothing process, which 
is the output of the first shifter 11. Whereas if the output 
of the second absolute differential value calculation circuit 
14 is equal to or greater than the quantization parameter 
QP, the second selector 16 selects the input pixel value that 
10 is the output of fourteenth register in the shift register 
group 1 . 

The output of the D mode operation is obtained through 
the above processing. 

Now, the operation of the T mode calculation circuit will 

15 be described. At cycle 15, the second shifter group 17 shifts 
the output of the tenth and of the eleventh shift registers 
in the shift register group 1 one bit to the left. The second 
two-input adder group 18 and the second shifter 19 calculate 
value "d" in equation (5) by using the output of the second 

20 shifter group 17 and the output of the ninth and of the twelfth 
shift registers of the shift register group 1. At cycle 16, 
the two-input adder 20 adds a (4), which is the output of the 
twelfth shift register in the shift register group 1, to the 
value d in equation (5), which is the output of the second 

25 shifter 19. At cycle 17 , the two-input subtracter 21 subtracts 
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the value d in equation (5) , which is the output of the second 
shifter 19, from a (5), which is the output of the twelfth 
shift register in the shift register group 1. As a result, 
the pixel value at the completion of the smoothing process 
is obtained. 

The following operation is performed to determine whether, 
as the output of the T mode operation, the pixel value obtained 
at the completion of the smoothing process should be output, 
or whether the input pixel value should be output unchanged. 

The third comparator 22 compares the quantization 
parameter QP/2 with the absolute value of the value d in equation 
(5), which is the output of the second shifter 19. If the 
absolute value of the value d in equation (5) is equal to 
or smaller than the quantization parameter QP/2, the third 
selector 23 selects the pixel value at the completion of the 
smoothing process, which is the output of the two-input adder 
20 or the two-input subtracter 21. Whereas if the absolute 
value of the value d in equation (5) is greater than the 
quantization parameter QP/2, the third selector 23 selects 
the input pixel value, which is the output of the twelfth 
register in the shift register group 1. 

The output of the T mode operation is obtained through 
the above processing. 

An explanation will now be given for the operation of 
the operation mode determination circuit for determining 



whether the D mode operation or the T mode operation should 
be performed. 

The third absolute differential value calculation circuit 
24 obtains the absolute value for the difference in the output 
5 of the first register and the second register in the shift 
register group 1. Therefore, at cycle 2, whereat the output 
of the first register in the shift register group 1 is a(l) 
and the output of the second register is a(0), the absolute 
value (a(0) - a(l)) is obtained. And at cycle 3, whereat the 

10 output of the first register of the shift register group 1 
is a (2) and the output of the second register is a(l), the 
absolute value (a(l) - a(2)) is obtained. Hereinafter, in 
the same manner, for each cycle an absolute differential value 
is calculated for the difference between adjacent input pixel 

15 values. 

The fourth comparator 25 compares the output of the third 
absolute differential value calculation circuit 24 with the 
threshold value Thl . If the output of the third absolute 
differential value calculation circuit 24 is equal to or smaller 

20 than the threshold value Thl, a value of 1 is output. But 
if the output of the third absolute differential value 
calculation circuit 24 is greater than the threshold value 
Thl, a value of 0 is output. During a period extending from 
cycle 2 to cycle 10, the counter 26 cumulatively adds the 

25 output of the fourth comparator 2 5 and obtains the value f 
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in equation (1). The fifth comparator 27 then compares the 
output of the counter 2 6 with the threshold value Th2, and 
if the output of the counter 26 is equal to or greater than 
the threshold value Th2, the fourth selector 28 selects the 
output of the second selector 16. However, if the output of 
the counter 26 is smaller than the threshold value Th2, the 
fourth selector 28 selects and outputs the output of the third 
selector 23. 

Therefore, if the pixel value for a pattern wherein there 
is a moderate change between adjacent pixel values and block 
noise appears frequently is input to the filter, the D mode 
operation is selected and a more effective smoothing process 
is performed. Whereas if the pixel value for a pattern wherein 
there is a drastic change between adjacent pixel values and 
block noise appears seldom is input to the filter, the T mode 
operation is selected, and the amount of calculations performed 
during the smoothing process is reduced. 

As is described above, in this embodiment, a deblocking 
filtering apparatus can be provided for which hardware is 
employed to completely implement the D mode operation and 
the T mode operation of a deblocking filter defined by MPEG-4 
and an adaptive filter determination operation. The software 
process is not required, and the operations are performed 
in parallel, in synchronization with the timings whereat the 
pixel values are sequentially input. As a result, a fast 



filtering operation can be performed. 

According to the second aspect, the operation mode 
determination circuit of the deblocking filter operation 
apparatus in the first aspect performs a process before, in 
a time series, the processes for D mode operation circuit 
and the T mode operation circuit, selects either the D mode 
operation circuit or the T mode operation circuit as an adaptive 
operation circuit. When the deblocking filer operation 
apparatus determines the T mode operation is adaptive, the 
max_padding value and min_padding value are employed as the 
output of the selector group 8, so that signal changes in 
the first shifter group 9 and in the first two-input adder 
group 10 are limited. Thus, the power consumption required 
by the deblocking filtering apparatus of the first aspect 
can be even more reduced. 

As is described above, according to the invention, the 
employment is implemented of hardware that can efficiently 
operate in parallel the D mode operation circuit for the 
deblocking filter defined by MPEG-4, the T mode operation 
circuit and the circuit for selecting either circuit as an 
adaptive circuit. Therefore, the software process that uses 
the general-purpose calculator of the processor is not required, 
and a fast filtering process can be performed. 
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